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Abstract 

^^ ' The spontaneous violation of the CP symmetry in the next-to-minimal supersymmetric 

^D , standard Model (NMSSM) is investigated. It is found that the spontaneous violation of the 

CP symmetry can occur in the Higgs sector of the NMSSM for a wide region of the parameter 

space of the model, at the 1-loop level where the radiative corrections due to the top quark 

and scalar-top quark loops are found to generate the scalar-pseudoscalar mixings between the 

two Higgs doublets of the NMSSM. In our model, we assume that the masses of the left-handed 

and the right-handed scalar-top quarks are not degenerate. And we investigate our model 

Oh. anaytically: We derive analytical formulae of the 1-loop mass matrix for the neutral Higgs 

bosons. We calculate the upper bound on the lightest neutral Higgs boson mass under the 

assumption. It is found to be about 140 GeV for our choice of parameter values in the presence 

of the spontaneous violation of the CP symmetry in the NMSSM. Thus, the possibility of the 

k> , spontaneous violation of the CP symmetry is not completely ruled out in the Higgs sector of 

;_( ' the NMSSM if the masses of the left-handed and the right-handed scalar-top quarks are not 

5^ , degenerate. Further, the phenomenology of the K-K mixing within the context of our model 

is studied. The lower bound on CP violating phase in the K-K mixing is found to increase if 

either tan/3 decreases or At increases. 









I. INTRODUCTION 

The violation of the CP symmetry in the weak interactions has been with us more than several 
decades since Christenson et al. had discovered the CP violating process in weak K decays [1]. 
In the standard model (SM) of the electroweak interactions [2], the violation of the CP symmetry 
in the weak interactions is generally explained in terms of the complex phase that exists in the 
Cabibbo-Kobayashi-Maskawa (CKM) matrix for the charged weak current [3]. However, if the 
nature can be described by other theories than the SM, one may consider other possibilities of the 
CP violation than the complex phase in the CKM matrix. One of the possibilities is that the CP 
symmetry is spontaneously violated in the Higgs sector. If the violation of the CP symmetry be 
occurred in this way, it is required that the relevant models should necessarily have at least two 
Higgs doublets [4]. 

Evidently, we know that there are such models which have two Higgs doublets: The supersym- 
metric extensions of the standard models. They are the most strong candidates for the fundamental 
theory of the nature beyond the SM, which embrace many important characteristics of the SM. 
As is well known, the super symmetric extensions of the standard model need at least two Higgs 
doublets, in order to give masses to the up-quark sector and the down-quark sector separately [5]. 
Therefore, in those supersymmetric models, the CP symmetry can be violated spontaneously in 
their Higgs sectors, in principle. 

Naturally, many authors have investigated the minimal version of the supersymmetric standard 
model (MSSM) [6]. They have found that, at the tree-level, the vacuum cannot spontaneously 
violate the CP symmetry. It is because certain restrictions from the supersymmetry are imposed on 
the tree-level Higgs sector of the MSSM to conserve the CP symmetry. Thus, radiative corrections 
are taken into account in order to see if the CP symmetry be violated spontaneously in the MSSM at 
higher level. A couple of reasonable scenarios have been proposed in which the radiatively corrected 
Higgs potential of the MSSM leads actually the spontaneous violation of the CP symmetry. An 
unacceptable side effect of the spontaneous CP violation scenario in the radiatively corrected Higgs 
potential of the MSSM is that it leads to a very light neutral Higgs boson which has already been 
ruled out by the Higgs search at LEPl. Consequently, in order to obtain an experimentally viable 
spontaneous violation of the CP symmetry scenario in the SUSY model, the Higgs sector of the 
MSSM has to be extended. 

Among various non-minimal supersymmetric models the simplest one is the next-to-minimal 
supersymmetric standard model (NMSSM), in which a new neutral Higgs singlet field is introduced 
to the already-existing two Higgs doublet fields of the MSSM [7]. The NMSSM is apparently 
appropriate because, at the tree level, the upper bound on the lightest neutral Higgs boson mass 
of the NMSSM is larger than that of the MSSM. Moreover, in the NMSSM, the superpotential 
contains a new dimensionless coupling coefficient for the cubic interaction between the two Higgs 
doublet fields and the Higgs singlet field, which may replace the parameter ^ in the superpotential 
of the MSSM by developing the vacuum expectation value of the singlet Higgs field of the NMSSM. 

However, it has been shown that the NMSSM can not produce the violation of the CP symmetry, 
at least at the tree level by Romao [8]. It is because the vacuum which are chosen to violate the CP 
symmetry is found to have a mode with a negative squared masses for the neutral Higgs bosons. 
Consequently, the inclusion of the higher-order corrections to the NMSSM Higgs potential have 
been considered as a next step. 



Recently, Babu and Barr [9] have analyzed in the NMSSM at the 1-loop level to include the 
radiative corrections if they contribute to the spontaneous violation of the CP symmetry. It has 
been assumed in their analysis that the mass of the left-handed scalar-top quark is degenerate with 
that of the right-handed one. Their analysis show that the mass of the charged Higgs boson does 
not change by taking into account these radiative corrections and its mass is estimated to be smaller 
than about 110 GeV. Moreover, there is no relative phase among the vacuum expectation values in 
the 1-loop effective potential including these radiative corrections. In this case, the CP-violating 
minima are possible only when A is very small for tan/3 = 1, and thus two neutral Higgs bosons 
become very light. 

Independently, Haba, Matsuda, and Tanimoto [10] have investigated the spontaneous violation 
of the CP symmetry in the Higgs sector of the NMSSM using the 1-loop effective potential including 
radiative corrections due to top quark, scalar-top quark, bottom quark, and scalar-bottom quark 
contributions. Here, the degeneracy in the left- and the right-handed components have not been 
assumed. They have found numerically that the spontaneous violation of the CP symmetry can 
occur only in a very restricted region of the parameter space. For A = 0.16 and tan/3 = 1, their 
numerical calculations have estimated the upper bound on the lightest neutral Higgs boson mass 
to be about 36 GeV, and the sum of two lightest Higgs boson masses is around 93 GeV. Haba et 
al. also have calculated the mass of the charged Higgs boson. It has been found to be dependent 
crucially on the soft SUSY breaking scalar-quark mass ttiq. It is noticeable that the mass of the 
chasrged Higgs boson may be as large as about 721 GeV, which is considerably different from the 
case of Babu and Barr. 

In this paper we are going a little further into the investigation of the spontaneous violation 
of the CP symmetry in the neutral Higgs sector of the NMSSM. We also assume no degeneracy 
between the left-handed and the right-handed components of the scalar quarks, and we derive the 
1-loop corrections as far as we can analytically, in order to investigate the effects of parameters of 
the NMSSM upon the spontaneous violation of the CP symmetry. 

At initial stage, our Lagrangian density is assumed too to be invariant with respect to CP 
property. After electroweak symmetry breaking, the CP symmetry is spontaneously broken in the 
vacuum state of the potential. Our assumptions go in parallel with the above two analyses [9, 10] 
that the vacuum expectation values of the two Higgs doublet fields as well as that of the Higgs 
singlet field are complex in the Higgs sector of the NMSSM. Naturally, one of the three CP-violating 
complex phases can be eliminated by redefining the Higgs fields. Thus, the spontaneous violation 
of the CP symmetry is generated in terms of the remaining two physical phases. 

The radiative corrections to the neutral Higgs boson masses are investigated by using the 
effective potential method [11]. The 1-loop effective potential contains the contribution of the top 
quark and scalar-top quark contributions. The difference bewteen the work of Babu and Barr and 
ours is that we assume no degeneracy between the left- and the right-handed components of the 
scalar quarks, as aforementioned. 

Since there is an additional Higgs singlet field in the NMSSM, the mass matrix for neutral 
Higgs boson is a 5 x 5 matrix. We derive an analytical formula for the neutral Higgs boson mass 
matrix at the 1-loop level. This is the difference from the works of Haba et al.. Even though at 
the tree level the scalar-pseudoscalar mixing elements between two Higgs doublets are explicitly 
zero, radiative corrections generate non-zero values for these elements. The real symmetric mass 
matrix can be diagonalized by an orthogonal matrix and then the NMSSM leads to five neutral 



Higgs bosons. In the spontaneous violation of the CP symmetry scenario, the theoretical upper 
bound on the lightest neutral Higgs boson mass of the NMSSM is calculated in the context of the 
effective potential formalism. 

Then, we apply our result to the CP violations in K-K mixing numerically. Within the param- 
eter space of the NMSSM that we consider, the CP violation in K-K mixing are studied within 
the framework of the NMSSM. We find that even though the scalar Higgs bosons have not been 
discovered yet at LEP2, the possibility of the spontaneous violation of the CP symmetry is not 
completely ruled out in the Higgs sector of the NMSSM. 

This paper is organized as follows. In the next section we breifly describe the Higgs sector of the 
NMSSM within the scenario of the spontaneous violation of the CP symmetry in the Higgs sector 
of the NMSSM at the tree level, and then at the 1-loop level in the third section. The radiative 
corrections to the tree level Higgs potential are then taken into account to generate a viable CP- 
violating vacuum in the Higgs sector. The mixings between two Higgs doublets can occur through 
the radiative corrections due to the contributions from the top quark and the scalar-top quark 
contributions. The exact analytical expressions of the elements of the neutral Higgs boson mass 
matrix are derived in our scenario. At the 1-loop level, the parameter space of the NMSSM, and 
hence masses of the scalar Higgs bosons are constrained by the negative experimental results from 
LEPl. The upper bound on the lightest neutral Higgs boson mass is calculated to be about 140 GeV 
for our choice parameter values in the presence of the spontaneous violation of the CP symmetry 
in the NMSSM. In the fourth section, we apply our model into the case of the CP violation in the 
K-K mixing within the context of the spontaneous violation scenario in the NMSSM Higgs sector. 
The conclusions are given in the last section. 



II. NEUTRAL HIGGS SECTOR AT TREE LEVEL 

Here in this section, we briefly review the concept of the spontaneous violation of the CP 
symmetry in the NMSSM at the tree level. As is well known, the Higgs sector of the NMSSM 
consists of two Higgs doublet superfields H-f = {Hi, H^) and ifj = {H2 , H2), plus a Higgs 
singlet superfield N. The superpotential of the NMSSM contains only terms with dimensionless 
couplings. Ignoring all quark and lepton Yukawa couplings except for that of the top quark, the 
relevant part for the superpotential can be written as 

W = htQH2fR + XNH1H2 - ^N^ , 

where we denote for simplicity that H1H2 = HieH2 = H^H2 — H^ H2 ■ The superfield Q^ = 
{tL, bi) consists of the left-handed quarks of the third generation and the superfield t^ denotes 
the charge conjugate of the right-handed top quark. 

In the above superpotential, a global U(l) Peccei-Quinn symmetry is explicitly broken by the 
presence of the cubic term in N . Not for the term, i.e., if /c = 0, the Peccei-Qiunn symmetry would 
persist in the NMSSM superpotential, and the tree-level Higgs potential would lead to a mass- 
less pseudoscalar Higgs boson, or the pseudo-Goldstone boson, after electroweak gauge symmetry 
breaking. 



The tree level Higgs potential in the NMSSM can be written in terms of F-terms, D-ternis, and 
the soft SUSY breaking terms as 

Vtree = Vp + Vd + Koft 

where 

Vf = \X\^[{\Hif + |i?2p)|iVp + \HiH2\^] + \k\^\N\* - {Xk*HiH2N*^ + H.c.) , 

Vsoit = ml^\Hi\^ + mljH2f + m%\N\^-{XAxHiH2N + hAkN^ + }i.c.), (1) 

with gi and §2 being the U(l) and SU(2) gauge coupling constants, respectively. 

We assume that there is no explicit violation of the CP symmetry in the Higgs sector [12]. 
Therefore, the parameters A, k, Ax, and A^ are assumed to be all real. On the contrary, we 
assume that the violation of the CP symmetry can occur spontaneously through the existence of 
the complex phases in the vacuum expectation values of the three neutral Higgs fields: 

< 0\Hf\0 > = vie'^P' , 

< 0|//2°|0 > = V2e''P^ , 

< 0|iV|0 > = xe'^P^ , (2) 

where vi, V2, and x are assumed to be positive, and three non-trivial phases are introduced into 
the vacuum expectation values. As usual, tan/3 is defined as ^2/^1, and the top quark mass is 
generated by V2 of the Higgs doublet H2 as nit = htV2- One of the three complex phases can be 
eliminated by redefining the Higgs fields. The remaining two physical phases may be chosen as [10] 

e = (^^ + (^2 + 9^3 , 

5 = 3(^3- (3) 



In the spontaneous violation scenario of the CP symmetry, the vacuum is defined as the sta- 
tionary point with respect to the two CP violating phases 9 and 5. This stationary point or the 
minimum point is the CP violating vacuum. Thus, the CP violating vacuum with respect to these 
phases satisfies two minimum equations 

ds 

d < Vtrce{vi,V2,V3,0,S) > ^ , . 

Furthermore, one can use the three minimum conditions for vi, V2, and ^3 to eliminate the soft 
super symmetry-breaking masses m^ , Tnjj , and rnj^ in the Higgs potential. 



Now, in terms of those vacuum expectation values, the three neutral Higgs fields can be rewrit- 
ten by shifting them around the CP violating vacuum. They have three scalar components and 
three pseudoscalar components: One of the mass eigenstates of the three pseudoscalar components 
is a massless Goldstone mode. This Goldstone mode can be gauged away by a unitary gauge tans- 
formation, and we are left with five components for the neutral Higgs fields. Consequently, the 
three neutral Higgs fields may be expressed in terms of the five components as 



//? 



H}^ 



N 



a^f-^ 



P«'/'2 



-Jfi 



vi + —^{Si+ismpP))- , 
V2 + —i={S2 + i cos (3P) \ , 



(5) 



where 5*1, 5*2, and X are the scalar components, and P and Y are the pseudoscalar components. 

The mass matrix for the five neutral Higgs bosons is obtained by the second derivatives of 
the Higgs potential with respect to the corresponding Higgs fields evaluated at the CP violating 
vacuum as a symmetric 5x5 matrix: 



Mf. 



J* 



M: 



Si, 52 X 



Si, 52, X 



M. 



A, Y 



Si, 52, X 



(M 



Si, 52, X^ 



M 



A,Y 



A, Y 



where, respectively, the upper-left 3x3 submatrix and the lower-right 2x2 submatrix corre- 
spond to the scalar part and pseudoscalar part. The upper-right 3 x 2 as well as the lower-left 
submatrices correspond to the scalar-pseudoscalar mixing part in the nutral Higgs boson matrix. 
As aforementioned, if the CP symmetry is conserved in the Higgs sector, the submatrix for the 
scalar-pseudoscalar mixing would not exist in the neutral Higgs boson mass matrix. 

We obtain the tree-level elements for the mass matrix of the five neutral (scalar and pseu- 
doscalar) Higgs bosons explicitly as 






M. 



33 



Ml 



M, 



55 



Mf, 
Ml 
Ml, 



M 



{mz cos [3) + \x{A\ cos 9 + kx cos{9 — S)) tan /3 
{niz sin /3) + Xx{Ax cos 9 + kx cos{9 — S)) cot /3 , 

(2kx)'^ — kxAk cos 5 H v'^A\ sin 2/3 cos 9 , 

2x 
2\x{Ax cos 9 + kx cos{9 - 6)) 



~2^ 



sin 2/3 

A\ sin 2/3 cos 9 + 3kxAk cos 5 + 2Xkv^ sin 2/3 cos (6* - 5) , 
1 



23 



(A^w^ - T^mz) sin 2/3 - Xx{Ax cos 9 + kx cos{9 - 6)) 

2A xvcos P — XvsmP{Axcos9 + 2kxcos{9 — 5)) , 
0, 

— 3AA;f x sin /? sin(6' — 5) , 
2A xvsinP — Xvcos P{Axcos9 + 2kxcos{9 — 6)) , 



M|4 = 0, 

MI5 = — 3Xkvx cos (3 sm{0 — 5) , 

MI4 = Xkvxsm{e -6) , 

Mfg = 2AA;t;2 sin 2f3 sin(6' - 5) , 

MI5 = Af (Aa cos e - 2kx cos(e - (5)) . (6) 

Here, one should note that Mf^ = M^^ = imphes that there are no scalar-pseudoscalar mixings 
between the two Higgs doublets (between Hi and H2) in the Higgs sector. That is, the spontaneous 
violation of the CP symmetry is induced by the presence of the scalar-pseudoscalar mixing terms 
between among Higgs doublets and the Higgs singlet (between H1H2 and A^) and the cubic term 
of the singlet itself (among N"^) at the tree level. 

It can be seen that all the scalar-pseudoscalar mixings vanish if 9 = 5; in this case, at the tree 
level, the spontaneous violation of the CP symmetry can not occur in the Higgs sector. Then, the 
five neutral Higgs bosons are decomposed as three scalar Higgs bosons and two pseudoscalar Higgs 
bosons, and there is no mixing between the scalar and the pseudoscalar Higgs bosons: The 5x5 
mass matrix is decomposed as a 3 x 3 and a 2 x 2 submatrices. Therefore, in the NMSSM, the 
spontaneous violation of the CP symmetry can be realized by the presence of two phases 6 and 6. 

However, assuming that the two CP violation phases are not equal, the scalar-pseudoscalar 
mixing may happen inevitably in the Higgs sector, but it has been observed that in large areas 
of the parameter space of the NMSSM the spontaneous violation does not occur at the tree level, 
because one can always find a mode with a negative mass squared at the CP violating vacuum of 
the Higgs potential [8]. 



III. NEUTRAL HIGGS SECTOR AT 1-LOOP LEVEL 

Now, we turn to the 1-loop level. Since the radiative corrections due to the top quark and 
scalar-top quark contributions give significant contributions to the tree level Higgs boson masses, 
we include these contributions in order to see their effects on the spontaneous violation of the CP 
symmetry. The full Higgs potential is composed of the tree level part and the 1-loop level part 
written as 

y = V^rcc + ^1-loop • 

According to the Coleman- Weinberg mechanism [14], the 1-loop effective potential including the 
contributions of the top quark and scalar-top quark loops is given by 

^1-loop = :?S^ ^ -^1 ( log^ - ^ ) - 2A^^ (^log:^ _ 

where Mf (i = 1, 2) are the field dependent scalar-top quark masses, M? is the field dependent 
top quark mass, and A is the renormalization scale. If the top quark mass and the scalar-top quark 
mass are identical, then there is no net contribution from the radiative corrections to the tree level 
Higgs potential. 
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After spontaneous electroweak symmetry breaking, the masses of the left-handed and the right- 
handed scalar-top quarks are obtained from the 2x2 mass matrix for them. They are 






^t + 2 ("^Q + ^t) + -^\ cos 2/3 



1 



"^Q 



2 

2 I 42 



m\) -F ( -m^ 



12 



-rfir. 



COS 2/3 



+ m^^ Al -F A^x^ cot^ /3 -F 2^i Ax cot /3 cos Q 



(7) 



where m^ 



(5i + 52)^/2 and mi^ = giv^ 12 for w = ^?;f -^ v^ = 175 GeV. 



In the above equation, the scalar-top quark masses contain the mixing term between the left- 
handed and the right-handed scalar-top quarks as well as the terms proportional to the gauge 
couplings. If the contributions coming from the D-terms in the scalar-top quark mass matrix 
are neglected, the scalar-top quark masses possess a symmetry under interchange of mq and niT- 
Moreover, one may notice that the scalar-top quark masses possess one CP violation phase Q. If 
the left-handed and the right-handed scalar-top quarks are degenerate in mass, the mixing term 
between the scalar-top quarks would vanish and there would be no CP phase in the 1-loop effective 
potential. The radiative corrections due to the top quark and scalar-top quark contributions do 
not shift the CP violating vacuum along b direction. On the contrary, a shift of the CP violating 
vacuum along Q direction is induced by these radiative corrections because the scalar-top quark 
masses depend on Q. 

Now, the two minimum equations 



86 

d< V{vi,V2,V3,0,5) > 

de 



0, 



. 



at the 1-loop level yield 



tan (5 
k 



3Af2sin2/3sin6l 
3Af 2 sin 2/3 cos 9 + 2AkX ' 
levr^f 2 sin^ (3 Ax sin 6 - SmfAt sin Bf^rn- , rn- ] 
IGvr^w^x sin^ /3 sin(^ — S) 



(8) 



where the function / arising from radiative corrections is defined by 



/{ml, ml) 



{ml 



mt 



m 



A2 



2 
"1-2 



rrii log —77 — mn log — rr 



A2 



+ 1 



These are the conditions that are satisfied by the 1-loop CP violating vacuum. 



The full mass matrix at 1-loop level for the five neutral Higgs bosons is given by 

M2 = m2. + (5M2. 

where SM^, = 5M^ denotes the 1-loop level Higgs boson mass matrix elements, and Mf^ is the 
tree-level mass matrix obtained in the previous section. We calculate the exact analytical formulae 
for the elements of the neutral Higgs boson mass matrix at the 1-loop level. Our results are given 
by the complicated but exact expressions: 



5M\ 



5M\ 




m'fXxAi cos/3Al%("i|, "^|) 3m|cos2/? "i|"^| 



3m| cos (3 \ nifXxAi cos (3 A 1 log(m^-^ /m^^ ) 
IGtt'^v 1 vsinfS 2v J (m? —rn^) 

AA/2 ^ 3 \ mjAt^2 sin/?A |' gK, m|) 3^4 ^ 

22 87r2|«sin/3 2v J (m|-m|)2 An^v^ s\n^ [3 ^^ A'^ 




mfXxAt cot (3 cos / 4m 



VK 





sin^ /3 y 3 

}AtA2 sin/3A | log(m|/m|^) 
w sin /3 2v \ {nij — nij ] 



2mi m|sin/? y "^|"^| 
327r2t;2 Uin/3 2 i °^ A^ 



2 SmfX^cot^p Ai \ 2 2^ 

^•^ 87r2 \m^- -rri^r I ^ *i *2' 



3m? A At cot j3 cos ., 

167r2x ■'^ *i' *2 



2 2 
m,r 



2 3mn^xMf sin^6' S-lwi^, "^? j Sm^Ax^t cos6l ,,2 2^ 

^ — i i £1 E2 1 i : f(m- m- 

STT'^v^sm^P {m} -m}f IQn'^v'^ sin^ (3 cos (3^ *i' *2^ 



t2 tl' 

,4x2 /,2„^+2 /o,- 2/1 nCm? m? ^ Q^2 > 



2 _ 3m^AM2 cot2 /? sin^ 6 9[m^^ , m^^ ) , SmfXAt cot /J cos g ^^ 2 2^ 

^^^^55 - ^:^2 f™2 _ ^2 A2 + [^^^2;; /i"^ti' "^t2. 



2 _ 3 jmj^AxAi cos /3A 1 I m^^t A2 sin/3Al 5("i|, "^|' 




«^2 1 ,,oinfl 9^^ ( I tisin/3 2f j (m? — m,? )2 

. 2m|AxyliCOs6l I 2 2 n 

sm 23 TT— > J (mf , m^ ) 

sin2/3 j''^ ti' t2^ 

Ax Ai cos 13 A \ log(m| /m| ) 



V sin /? 2f (mj — m^ 



+ 



,,.2 ^2 

3m| cos /3 J mf AiA2 sin /3A 1 log(m|/m| ) 
327r2ti 1 fsin/? 2v J (m,? —mi) 



5M\ 



5Ml^ 



6M'. 



5Ml 



5M] 



TUr 



„^9 3 imfXxAi COS/3A1 m?Acot/3Ai , , 

Srri'^A 
iDTT^wsmp '^l 

Sm'ymfX cos /3 cot /3 



327r2w 

2 Sm^Axvlisin^ J mfXxA 

8-k'^v sin^ /? I f sin /? 

Sm^XxAt cot /3 sin 
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Wtt^v^ sin/3 
3?7ij A^t cot /3sin 
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3m^AAt cot /3sin 
Wtt^v sin f3 
3 imf At A2 sin/?Al mfAcot/3Ai 



Smf X At cot /3 cos 9 „ , o 
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16iT^vsm(3 
3m^Acos/3 / 4?tt,j 



24 - ^32 



327r2ti Isin^/? 
3m2AxyliSin^ {rn^AtA 



Svr^usin /3 [ fsin/3 



3m?Aa;^+sin0 



/K' 




mr 



3m?AAt cot (5 sin 9 { m'f At A2 

Svr^ I wsin/? 2^ 

3771,2^^^ cot /3sin0 J 2 2n ""Z 

+ 167r2t;sin/3 V ^""ti' ""ta^ + 2(m? - m? ) 
2 _ 3m^A2xAfCot/3singAig(m|, m|) 3m2AAtsing 2 2^ 

34 8^2^ sin2 ^ (^1 _ ^1 )2 + i67r2t, sin2 /3 -^ ^""'i ' ""^^ J 

^^ . _ 3m^A2A,cot2/3singAiff(mg^, m|) 

12 ti^ 



3m^A2a;^2pot/3sin2 6l ^("il, "^|) 3m^AAtcos6' 
^^ ~ 87r2t;sin2/3 (m? - m? )2 + 167r2t;sin2/3 



1fi7r2„cir,2 « •' ^ <! ' ^2 ^ ' ^ '' 



<2 tl' 



with 



Ai = At cos 6 + Xx cot (3 , 
A2 = At + Xx cot (3 cos 6 , 

A = I (™j - ,4) + fi^ - M) ™ 2/5} (*-^-'-^], (10) 



and 

/ 2 2n "7-2 + mf , ml 
5 mt,m^ =^ |log^ + 2 . 

mf — 771-2 "^1 

Here, in the hmit of sin0 = 0, some of the elements of SM"^ vanish. In this hmit, the radiatively- 
corrected mass matrix of the neutral Higgs bosons reduces to the one obtained without the spon- 
taneous violation of the CP symmetry [7] . 

We also remark that the spontaneous violation of the CP symmetry forbids a non-zero CP phase 
in our scenario at the 1-loop level ii 6 = 5 at the tree level. This is exactly what the Georgi-Pais 
theorem [13] says: The radiative CP violation can be realized when at the tree level there exist 
massless Higgs bosons other than Goldstone bosons. That is, spontaneous CP violation does not 
occur in the NMSSM Higgs sector through only radiative corrections because at the tree level there 
is no pseudo- Goldstone boson. 

One can notice that the scalar-pseudoscalar mixing elements of the radiatively corrected mass 
matrix 5M^ of the neutral Higgs bosons are nonzero, as far as 9 is nonzero, assuming the non- 
degeneracy of the left-handed and the right-handed scalar-top quark masses. The magnitudes of 
these elements are proportion to sin 9. The scalar-pseudoscalar mixings between two Higgs doublets 
generated by the radiative corrections would not occur if the degenracy of the left-handed and the 
right-handed scalar-top quark masses in the 1-loop effective potential is assumed. 

The five physical neutral Higgs bosons are defined as the mass eigenstates, obtained by diago- 
nalizing the mass matrix at 1-loop level, by the help of an orthogonal transformation matrix. The 
elements of this orthogonal transformation matrix determine the couplings of the physical neutral 
Higgs bosons to the other states in the model. Let us denote the physical five neutral Higgs bosons 
as hi (i = 1,2,3,4,5). We take the mass eigenvalues in increasing order of the mass eigenstates hi. 

Constraints of the NMSSM parameter space arise from searches for the Higgs bosons at the 
LEPl. In our numerical analysis, we have used the following experimental constraints from LEPl. 
The fact that two Higgs bosons have not been produced in the decay of Z gives the condition of 
nifi^ + m/i2 > "T-z- In the case of mh^ + m/^j < ^tT'Z, the decay Z ^ hih2 is kinematically allowed 
and the branching ratio B{Z — > /ii/i2) should be smaller than 10~^. For two Higgs bosons {hi, /12), 
both B{Z -^ hil^l~) and B{Z -^ h2l^l~) should be smaller than 1.3 x 10^^. In our numerical 
analyses, the renormalization scale and the mass of the top-quark [14] is fixed as 1000 GeV and 
175 GeV, respectively. The upper bounds on A and k are given as 0.87 and 0.63, respectively, 
by the renormalization group analysis of the NMSSM [15]. The phase 6 and coupling costant k 
is determined by two minimum conditions (Eq. 8) of the Higgs potential. Assuming the same 
soft SUSY breaking scalar-quark masses (niQ = rriT), we can determine they by the relation, 
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Am'^/m'^ ~ 1/30. Here the scalar-top quark masses are constrained to be very heavy for later 



ft 
convenience 



Within the context of our model, we plot the masses of the neutral Higgs bosons by the Monte 
Carlo method using the above formulae for reasonable regions of the parameter space. Fig. 1 shows 
at the 1-loop level the three lighter neutral Higgs boson masses mfi^, nifi^, and m/jg as functions of 
At, for < 6* < 27r, 1 < tan/3 < 10, < A < 0.87, and < Ax, -Ak,x < 1000 GeV. One can see 
in Fig. la that many points are excluded for the range of rrihi < "^^ by the negative experimental 
results at LEPl; but the LEPl data do not completely exclude the existence of a massless neutral 
Higgs boson of the model at the 1-loop level. 

Our numerical result does not seem to be compatible with that of recent research [10]. It 
was recently pointed out that at the 1-loop level a wide region of the NMSSM parameter space 
is excluded for spontaneous CP violation. Especially the range of tan/3 > 1 is completely ruled 
out in this scenario and then in this analysis nih-^ is relatively small ( ~ 35 GeV) for most of the 
parameter space. Here Haba at al. [10] did not consider the range of ^^ < in their analysis. The 
sign of Ak values need not be positive when CP is spontaneously violated in the Higgs sector. 

The range of Ai^ < plays a important role in allowing spontaneous CP violation in the NMSSM 
because of in the minimum equation the sign of k is negative for a reasonable parameter space. 
Thus the range of tan/3 > 1 is allowed for spontaneous CP violation in the Higgs sector of the 
NMSSM in our analysis. In the parameter space of Fig. 1 but the range of A^ > 0, spontaneous 
CP violation is not allowded in the NMSSM even though radiative corrections are included. Figs, 
lb, Ic display the allowed ranges of 60 < m/^j < 245 GeV for m/^j ^-nd of 100 < mh2 < 525 GeV 
for rri/ig. In these figures the upper and lower bounds on the neutral Higgs mass boson masses are 
theoretical and experimental bounds, respectively. We also calculated rrih-^ for the same parameter 
space as that of Fig. 1 without spontaneous CP violation in the NMSSM. The upper bound on 
TJih-^ is decreased by spontaneous CP violation in the Higgs sector. 



IV. K-K MIXING IN NMSSM 

We now explore their phenomenological implications for spontaneous CP-violating effects in K- 
K mixing. In the SM, the K-K mixing arises from the W^-exchange box diagram giving rise to the 
AS" = 2 operator at the 1-loop level. In the NMSSM, there are dominant sources for CP violation 
in the K-K system through box diagrams involving superpartners (superbox). In the superbox 
diagrams, the gauge fermion couplings are described by the super-CKM unitary matrices which 
diagonalize the scalar quark mass matrix [16]. The super-CKM matrix is real in the spontaneous 
CP violation scenario that we concentrate on. 

After electroweak symmetry breaking takes place, the gauginos and Higgsinos with the same 
spin combine to form mass eigenstates, charginos and neutralinos. The complex mixing between 
gauginos and Higgsinos induce a complex chargino or neutralino propagator [17]. In the case, 
the superbox diagrams contain couplings among quark scalar-quark, and Higgsino so that their 
contribution to the imaginary part of K-K mixing is suppressed by a factor of mq/mw- If the 
superbox diagrams contain the weak phase in a scalar quark propagator, the superbox digrams 
receive a suppression factor of mq/niq. Thus, the dominant contributions to the imaginary part 
of K-K mixing come from those including the left-right scalar-top quark mixing. The superbox 
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diagrams for these contributions are displayed in other papers [17, 18]. Assuming that scalar-top 
quarks are very heavy rrii » rriy^ and the upper bound on I^m~/m~ is saturated as 1/30, the ratio 
of the imaginary and real parts of the K-K mixing can be described by the quantity [18] 



rrit \ iJmLRyiszsinc/) j Am^ 

2 1 ^2 

i , 



V sin (3 J m^^mj \ m 



:ii) 



where z = 0.5 is a partial cancellation factor, to-lr is the left-right scalar-top quark mixing, m^ 
is the average of the scalar-top quark masses, V13 = 10~^ is a element of the super-CKM matrix 
for the scalar-quark, and m^ is the superpartner (wino) of SU(2). The CP-violating phase 4> is 
expressed as a function of two phases (6, 6) of VEV's. 

We impose the experimental constraints at LEPl on the NMSSM parameter space and then 
estimate numerically CP-violating effects in K-K mixing by using the parameters obtained in the 
context of spontaneous CP-violating scenario. The experimental upper bound on the ratio of K-K 
mixing is given by 6 x 10~^ [16]. This bound impose a constraint on the weak CP phase. The 
wino is not exist as a mass eigenstate. Thus we fix as m^r = 100 GeV for heavy scalar-top quarks. 
We use Eq. 11 for the ratio of the K — K mixing and plot in Fig. 2a the lower bound on the weak 
phase (p as a, function of At, for < tan/3 < 10, < ^ < 27r, < A < 0.87, and < Ax, —Ak,x < 
1000 GeV. One can notice that the lower bound on (j) becomes small as the value of At decrease. 
Fig. 2b shows the lower bound on the weak phase (j) as the same parameter space of as that of 
Fig. la but as a function of tan (3. In Fig. 2b the lower bound on (j) increases as the values of tan (3 
decrease. 



V. CONCLUSIONS 

Spontaneous CP violation is investigated in the Higgs sector of the NMSSM. In previous 
analyses [9] , it has been shown that the spontaneous violation of the CP symmetry can be realized 
in the NMSSM Higgs sector by radiative corrections coming from the degenerate scalar-top quark 
masses. In this case, however, the presence of the CP violating vacuum requires a very light Higgs 
boson in the model. By considering the negative results in the Higgs search at LEPl, the possibility 
of the spontaneous violation of the CP symmetry is almost completely excluded in the Higgs sector 
of the NMSSM, if the scalar-top quark masses are degenerate. The numerical analysis also have 
shown [10] that the situation is hardly improved when the radiative corrections including the mass 
spliting effect between the scalar-top quarks are taken into account. 

Here we reanalyze the possibility of spontaneous CP violation in the Higgs sector of the NMSSM 
with the non-degeneracy of the scalar-top quark masses in the 1-loop effective potential. In this 
analysis the Higgs potential contains radiative corrections due to the top-quark and scalar-top 
quark contributions. In the NMSSM the mass matrix of the neutral Higgs boson is analytically 
derived in spontaneous CP violation scenario. In the range of ^^ > CP violation is not realized 
even though radiative corrections due to the these contributions are included in the Higgs sector. 
On the contrary, CP violation scenario is viable in the range of Ak < 0. Assuming both scalar-top 
quarks are much heavier than the wino and scalar-top quarks are maximally degenerated in their 
masses, the neutral Higgs boson masses are numerically calculated. The three neutral Higgs bosons 
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are relatively light. The upper bound on the lightest neutral Higgs boson mass is about 140 GeV 
under our choice for the parameter space. This upper bound increases if spontaneous CP violation 
does not occur in the Higgs sector. In the 1-loop parameter space of the NMSSM, the lower bound 
on the phase (p is calculated by using the experimental result for the ratio of K-K mixing. The 
lower bound on the phase (p increase as tan/3 values decrease or as At values increase. In the 
NMSSM Higgs sector, a possibility of spontaneous CP violation scenario can not be completely 
ruled out by the Higgs search at LEP. 
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Figure Captions 



Fig. 1 : (a) nifi^, (b) m^jj) ^^^ (c) ^n-/i3 as a function of At, for < 6 < 2tt, 1 < tan/3 < 10, 
< A < 0.87, and < Ax, -Ak, x < 1000 GeV. 



Fig. 2 : The lower bound on as a function of (a) At and (b) tan/? 



15 



rrihi (GeV) 



a 







80 



60 



40 




100 200 300 400 500 600 700 

\ (Ge 
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